System, method and apparatus for adaptive driver training

ABSTRACT

An application for an adaptive training system includes a computer interfaced to one or more graphics displays, one of more input/output devices and having access to a plurality of training segments. The input/output devices are in communication with a trainee. Software operates in either a simulation mode in which a trainee interacts with the adaptive training system as if the trainee was operating a target vehicle or in a training mode in which the trainee receives computer-based training from the adaptive training system, in particular, when the trainee does not perform well during the simulation mode of operation.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.14/285,017, filed May 22, 2014 which in turn is a continuation of U.S.patent application Ser. No. 12/889,448, filed Sep. 24, 2010, issued asU.S. Pat. No. 8,770,980 on Jul. 8, 2014, which in turn is anon-provisional application taking priority from U.S. patent applicationSer. No. 61/277,768 filed Sep. 29, 2009, the disclosures of which arehereby incorporated by reference. This application is related to U.S.Pat. No. 8,894,415 issued Oct. 25, 2014. This application also isrelated to U.S. Pat. No. 8,469,711 issued Jun. 25, 2013.

FIELD

This invention relates to the field of training and more particularly toa system that adapts to the current skills of the trainee.

BACKGROUND

Driving training simulators are well known. Such simulators oftenincluded controls that simulate the target vehicle (e.g. car, truck,bus, etc). It is known that such simulators improve skills and safety byfamiliarizing the trainee with operation of the vehicle by presentingsimulated situations in which, making the wrong decision does not resultin a potential accident or bodily harm. In this way, the trainee learnsbasic driving skills before they eventually need to perform using theactual target vehicle and before they have to perform using that vehiclewhile operating in traffic.

There are many types of simulators known. The simplest simulator is atypical driving video game having a display screen and a handcontroller. In some systems, a simulated steering wheel is provided. Amock-vehicle is displayed on the display screen and the driver uses thehand controller to keep the mock-vehicle on a simulated, moving roadwayon the display screen. This type of simulator helps build driver handand eye coordination, but does not provide the true control operation ofthe real steering wheel, brake, clutch, shifter, windshield views andmirror views. Such simulators are more of a game than an actual drivertraining system.

Another type of simulator includes a video display screen to simulate awindshield view, a steering wheel, a gas pedal, a brake pedal, a shifterand, optionally, a clutch pedal. A road situation is displayed on thedisplay screen and the driver uses the controls to drive the simulatedvehicle, moving down a roadway that is displayed on the display screen.This type of simulator helps build driver skills, but does not includeinteraction with speedometers, tachometers, etc. Such simulators don'tprovide feedback from the shifter such as gear grinding when the clutchisn't operated correctly. Furthermore, such simulators have a fixedconfiguration relating to a single type/layout of vehicle. In some suchsimulators, certain gauges are provided to simulate the operation andinformation provided to a driver of this singular vehicle. All currentsimulators provide fixed scenarios to the trainee and evaluate thetrainee responses in a fixed program, progressing from scenario toscenario in a linear progress.

None of the current driver training simulators provide trainingsimulations that automatically adapt to the skills of the trainee. Noneof the current driver training simulators provide realistic shiftingexperience in which clutch/shifter coordination is required andtactile/audible feedback is provided when not operated correctly. Noneof the current driver training simulators provide configurable,interactive instrument clusters that react to touch of the trainee whileadapting to the layout of any of many target vehicles.

What is needed is a driver training system that provides trainingscenarios that adapt to the skill level demonstrated by the trainee.

SUMMARY

In one embodiment, an adaptive training system is disclosed including acomputer that is interfaced to a storage device, the storage devicehaving a plurality of training segments stored thereon and accessible bythe computer. One or more graphics displays are interfaced to thecomputer, at least one of which simulates a windshield of a targetvehicle and the computer generates images on the graphics displays. Oneof more input/output devices are interfaced to the computer andcorrespond to control/display devices of the target vehicle; theinput/output devices are in communication with a trainee (e.g. signalthe trainee or monitor actions of the trainee). Software running on thecomputer selects a first segment of the training segments as the currentsegment and operates on the current segment by presenting the currentsegment on one or more of the graphics displays and input/outputdevices, thereby simulating an operation of the target vehicle. Thesoftware collects data from the one or more input/output devices andanalyzes the data to determine a level of competency of one or moreaspects of the current segment. The software determines one or more nextsegments from the training segments based upon the level of competency.The next segments correspond to either one or more aspects of thecurrent segment of which the trainee demonstrated abilities or which thetrainee demonstrated a lack of abilities. The software then selects oneof the next segments as the current segment and repeats the above.

In another embodiment, method of training a trainee on a training systemis disclosed. The training system includes a computer that has a storagedevice and a plurality of training segments which are stored on thestorage device and accessible by the computer. The computer isoperatively interfaced to one or more graphics displays. At least one ofthe graphics displays simulates a windshield of a target vehicle. Thecomputer generates images on the graphics displays. The computer is alsooperatively interfaced to one of more input/output devices thatcorrespond to control/display devices of the target vehicle such as asteering wheel, brake pedal, gas pedal, shift simulator, etc. Theinput/output devices are in communication with a trainee to provideindicators to the trainee and determine what the trainee is doing. Themethod includes (a) selecting a first segment of the training segmentsas the current segment and (b) presenting the current segment on one ormore of the graphics displays and input/output devices, therebysimulating an operation of the target vehicle. (c) Data is collectedfrom the one or more input/output devices and (d) analyzed to determinea level of competency of one or more aspects of the current segment then(e) one or more next segments from the training segments is determinedbased upon the level of competency. The next segments corresponds toeither one or more aspects of the current segment of which the traineedemonstrated abilities or the next segments corresponds to either one ormore aspects of the current segment of which the trainee demonstratedlack of abilities. Steps b-e are repeated until a session is complete.

In another embodiment, an adaptive training system is disclosedincluding a computer that includes storage with a plurality of trainingsegments stored in the storage and accessible by the computer. Thecomputer is interfaced to one or more graphics displays. At least one ofthe graphics displays simulates a windshield of a target vehicle and thecomputer is interfaced to the displays for generating images on thegraphics displays. The computer is also interfaced to one of moreinput/output devices. The input/output devices correspond tocontrol/display devices of the target vehicle such as meters, steeringwheels, pedals, etc, and the input/output devices communicate with atrainee (e.g. signal the trainee or determine if the trainee hasactivated the input/output device by hand or foot). The adaptivetraining system has a way to select a first segment of the trainingsegments as a current segment and to execute the current segmentincluding displaying content of the current segment on one or more ofthe graphics displays and input/output devices, thereby simulating anoperation of the target vehicle. Data is collected from the one or moreinput/output devices while the current segment is executing and analyzedto determine a level of competency of one or more aspects of the currentsegment. One or more next segments from the training segments isdetermined based upon the level of competency, corresponding to eitherone or more aspects of the current segment of which the traineedemonstrated abilities of which the trainee demonstrated lack ofabilities and one of the next segments is selected as the currentsegment and continuing using the selected segment as the currentsegment.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention can be best understood by those having ordinary skill inthe art by reference to the following detailed description whenconsidered in conjunction with the accompanying drawings in which:

FIG. 1 illustrates a perspective view of a training system.

FIG. 2 illustrates a second perspective view of a training system.

FIG. 3 illustrates a plan view of a training system dashboard.

FIG. 4 illustrates a perspective view of a shifting training sub-system.

FIG. 5 illustrates an exploded view of the shifting training sub-system.

FIG. 6 illustrates a perspective view of the shifting trainingsub-system showing the handle connection.

FIG. 7 illustrates another perspective view of the shifting trainingsub-system.

FIG. 8 illustrates a perspective view of the shifting trainingsub-system showing the force sensor.

FIG. 9 illustrates a schematic view of an exemplary training system.

FIG. 10 illustrates a flow chart of the prior art.

FIG. 11 illustrates a flow chart of the adaptive training system.

FIG. 12 illustrates a schematic view of a typical computer system.

DETAILED DESCRIPTION

Reference will now be made in detail to the presently preferredembodiments of the invention, examples of which are illustrated in theaccompanying drawings. Throughout the following detailed description,the same reference numerals refer to the same elements in all figures.In general, the training system 10 is often known as adriving/flying/boating/engineering/etc simulator, depending upon thetarget vehicle (car/truck, airplane, boat, train, etc). The trainingsystem 10 is any system for training a trainee (e.g. truck drivertrainee) that simulates some or all of the operator controls (e.g.steering, brake, shifter) and visuals (e.g. mirrors, windows, dashboards, etc) without requiring the trainee to operate the actual vehicle(e.g., drive the actual truck). Although not limited to any particulartarget vehicle, the remainder of this description will use a truck as anexample of such target vehicle for brevity reasons. Note that some ofthe controls described (e.g. shifter, clutch, steering wheel) arerelated to certain types of target vehicles and not necessarily toothers. For example, many automobiles have automatic transmissions and,therefore, do not have a clutch. In another example, an airplane doesnot have rear-view mirrors, shifters, clutches, etc. Likewise, a truckdriving simulator has rear-view mirrors, shifters, clutches, but doesnot have airelons, thrust, altitude gauges, etc.

Referring to FIG. 1, a perspective view of a training system 10 isshown. The training system 10 is supported and/or housed by/in a cabinet8. The training simulator 10 provides life-like training without orbefore operation of the target vehicle, in this example a vehicle suchas a truck or an automobile.

The exemplary training system 10 has a windshield display 12 on which asimulated driving situation is presented as the trainee 5 would seethrough the windshield of the target vehicle. The windshield display 12shows, for example, the road being driven upon, the grade of the road,obstacles such as other vehicles, tress, parked cars, pot holes, etc. Insome training scenarios, the windshield is fogged or distorted bysimulated weather condition s such as rain, snow, sleet, etc.

The trainee 5 typically sits on a seat 20 that, preferably, though notrequired, mimics a seat of the target vehicle. The trainee 5 hascontrols similar to those in the target vehicle such as a steering wheel30, horn 31, gas pedal 32, brake pedal 34, clutch 36 (see FIG. 2), andshifter having a shifter shaft 99 and a shifter handle 98 and shiftersub-system 80. The shifter subsystem is often covered with a boot 84 tokeep dust, liquids, etc from damaging the working components.

In a preferred embodiment, though not required, the steering wheel 30and shift handle 98 have touch sensors that detect if and when thetrainee 5 has is grasping the steering wheel 30 and/or shift handle 98.The touch sensors are any known touch sensor such as a mechanical switchor switches, capacitive or resistive detectors, etc. In someembodiments, the position of the trainee's hands is determined by thecamera(s) 13 in conjunction with or instead of the touch sensors.

In some embodiments, a force or strain detector 123 (see FIG. 8) iscoupled to the shifter arm 99. The strain detector 123 providesinformation to determine how hard the trainee 5 is pushing or pullingthe shifter handle 98.

In a position similar to that of a dashboard of the target vehicle is adashboard (e.g. display) 14 (details of an exemplary dashboard 14 areshown in FIG. 3). The dashboard 14 contains displays and indicators thatinform the trainee 5 of various target vehicle and external conditionssuch as speed, engine speed (RPM), engine temperature, outsidetemperature, brake temperature, air pressure, oil pressure, etc. In someembodiments, the dashboard 14 is fabricated from actual meters,indicators, etc, as in the target vehicle. In a preferred embodiment,the dashboard 14 is a graphics display on which the meters, indicators,etc of the target vehicle are displayed/simulated. It is also preferredthat each sub-component of the dashboard 14 is touch-sensitive. In such,the training system 10 prompts the trainee 5 to, for example, “touch”the tachometer, and the training system 10 receives a signalcorresponding to the sub-component/icon that the trainee 5 touches. Inembodiments in which the dashboard 14 is a graphics display, it isanticipated that the graphics display is touch-sensitive such that atouch over a displayed sub-component signals the training system 10 ofthe location touched, and therefore, the identification of thesub-component that is touched. In embodiments in which the dashboard 14is fabricated from actual meters, indicators, etc, some or allsub-components have touch sensors such as pressure detectors orcapacitive touch sensors, etc.

In some embodiments, one or more side-view mirror displays 42/44 aremounted on or in the cabinet 8. When provided, the side-view mirrordisplays 42/44 show a simulated view of what is visible to the trainee 5such as vehicles being passed and/or approaching vehicles. In someembodiments, the side-view mirror displays 42/44 display objects as theywould appear in a real side-view mirror simulating concave or convexmirrors as appropriate. Additionally, in some embodiments, the imagedisplayed includes simulated dirt, etc, as often occurs in real life.

In some embodiments, a center-mounted rear-view display 43 is alsoprovided (not shown). When provided, the rear-view mirror display 43shows a simulated view of what is visible to the trainee 5 such asapproaching vehicles and/or oncoming vehicles.

In some embodiments, an information display and input device 16 isprovided. The information display and input device 16 does not simulatesomething from the target vehicle. Instead, the information display andinput device 16 presents menus, status information, and auxiliaryinformation to the trainee 5 and accepts inputs such as scenarioselection, study chapter selection, login data, etc.

In some embodiments, an audio system 18 is provided to enhance realismand provide simulations of sounds that are normally heard when operatingthe target vehicle such as engine noise, tire noise, other vehicles,rain or sleet hitting the target vehicle, emergency vehicles, sounds ofa collision, etc.

In some embodiments, one or more trainee sensors 13 are provided todetect various aspects of the trainee 5 such as position upon the seat20, head angle, attention, drowsiness, and where the trainee 5 islooking. This information is used to make sure the trainee 5 is properlyperforming the task at hand. The trainee sensors 13 are, for example,cameras, light detectors, ultrasonic transducers, or any other detectoras known in the industry. The trainee sensors 13 are coupled to the maincomputer 100 (see FIG. 9). The main computer 100 analyzes images fromthe trainee sensor(s) 13 to determine what the trainee 5 is doing and/orwhere the trainee 5 is looking to provide feedback to the trainee 5 andevaluate the trainee's abilities (e.g. the camera(s) 13 are used todetermine if the trainee 5 looked in the right mirror display 42 beforechanging lanes).

Referring to FIG. 2, a second perspective view of a training system isshown. In this view, an optional centrally-located rear-view mirrordisplay 43 is shown above the windshield display 12. When provided, therear-view mirror display 43 shows a simulated view of what is visible tothe trainee 5 such as vehicles being passed and/or approaching vehicles.In some embodiments, one, two or three mirror displays 42/43/44 areprovided.

In FIG. 2, the information display and input device 16 is shown withgreater detail. This display does not necessarily simulate a feature ofthe target vehicle, but in some embodiments, does contain features thatmap to a feature of the target vehicle. In this example, the informationdisplay and input device 16 includes an ignition switch icon 17 thatlooks like the ignition switch of the target vehicle. Typically, theinformation display and input device 16 shows informational messagessuch as information regarding the current courseware segment orsummaries of the last simulation (e.g. the trainee 5 hit two parked carsand knocked down one telephone pole, etc). In a preferred embodiment,the information display and input device 16 includes a touch screen. Insuch embodiments, the trainee 5 uses the touch capabilities to makeselections and to select items as requested (e.g. “touch the ignitionswitch”).

In some embodiments, the windshield display 12 is also touch sensitive.This provides even more capabilities for testing the trainee's 5 abilityto identify environmental (e.g. roadway) objects such as signs,barriers, etc. For example, the trainee 5 is asked to touch the stopsign or touch the lane in which is most appropriate for his/her vehicle,etc.

Again, in some embodiments, one or more trainee sensors 13 areintegrated into the training system 10. The trainee sensors (e.g. cameraor cameras) 13 are coupled to the main computer 100. The main computer100 analyzes data from the trainee sensor(s) 13 to determine what thetrainee 5 is doing and/or where the trainee 5 is looking to providefeedback to the trainee 5 and evaluate the trainee's abilities (e.g. thetrainee sensor(s) 13 are used to determine if the trainee 5 looked inthe right mirror display 42 before changing lanes). The traineesensor(s) 13 are positioned as needed to determine the position, stanceand view of the trainee 5.

Referring to FIG. 3, a plan view of an exemplary training systemdashboard 14 is shown. The dashboard 14 contains displays and indicatorsthat inform the trainee 5 of various target vehicle internal andexternal conditions such as speed 54, engine speed 52 (RPM), enginetemperature 56, outside temperature 58, battery voltage 60, air pressure64, oil pressure 66, fuel reserve 68, oil temperature 70 etc. In someembodiments, the dashboard 14 is fabricated from actual meters,indicators, etc, as in the target vehicle (not shown). In a preferredembodiment, the dashboard 14 is a graphics display on which the meters,indicators, etc of the target vehicle are simulated by images (e.g.icons) of the respective components from the target vehicle. In thisway, the dashboard 14 is reconfigurable between different targetvehicles (e.g. some vehicles have more/less meters and more/less “idiotlights”).

It is also preferred that each sub-component of the dashboard 14 istouch-sensitive. In the example of FIG. 3, the entire graphics display14 is touch sensitive (touch panel as known in the industry) and,touching of any of the sub-components 52/54/56/58/60/62/64/66/68/70signals the main computer 100 that the corresponding sub-components52/54/56/58/60/62/64/66/68/70 was touched. This provides the capabilityof questions/response scenarios like, “touch the fuel gauge . . . ” anddetection of the icon (sub-component 52/54/56/58/60/62/64/66/68/70) thatwas touched.

In some embodiments, status or identification information 50 is providedon the dashboard 14 such as the vehicle details and, perhaps, the nameof the trainee 5, etc.

Referring to FIGS. 4 through 8, views of a shifting training sub-system70 are shown. The shifting training sub-system 70 includes atransmission simulation section 80, a shaft 99 and a handle 98. In someembodiments, a touch detector 118 is provide on the handle 98 fordetecting if a hand of the trainee 5 is touching the shifter handle 98,for example, a capacitive sensing detector 118.

The transmission simulation section 80 is preferably a two plate design.The transmission simulation section 80 includes a top plate 103 and thebottom plate 104. The top plate 103 and the bottom plate 104 allowtravel of the shifter in the “Y” direction. One or more linearbearing(s) 140/142 enable movement of the top plate 103 relative to thebottom plate 104 in the “Y” direction for a limited distance. Thisprovides the “Y” direction travel for the shifter shaft 99.

When the top plate 103 moves relative to the bottom plate 104, a springloaded “Y” ball detents 114 provide several natural stopping locationssimilar to those of the transmission of the target vehicle. The “Y” balldetent 114 and the “Y” detent grooves 115 provide the natural stoppinglocations as well as simulated increase and release of force whenshifting into simulated gear positions. The spring loaded “Y” balldetent plungers 114 provide a simulated feel of gear engagement as shifthandle 98 and arm 99 are pushed.

Located on the bottom plate 104 is a transmission lock out solenoid 116.A movable core of this computer controlled transmission lock outsolenoid 116 engages with the top plate 103, locking the top plate 103in position over the bottom plate 104 under control of the computer 100.This provides simulated limited “Y” movement and simulates gear changerestrictions and also provides an actuator system that locks theoperator out of gear if a shift operation is missed.

Attached (e.g. by screws 145) to the bottom plate 104 is an H-gate 109.The H-gate 109 limits the “X” direction travel of the shifter shaft 99.A shift arm guide 110 mesh into detents 147 of the H-gate 109. Onlycertain combinations of positions of X and Y displacements are allowedby the H-gate 109 and shift arm guide 110. This provides limits to totaltravel of the shift arm guide 110 by amounts limited by the combinationof the X and Y travel and in appropriate simulated shifting patterns.

The transmission top plate 103 also includes the transducer system 106.The transducer system 106 outputs noise and vibration to simulate gearbox noise and vibration. This transmission noise and vibrations areconducted through parts of the transmission shaft 99 to provide the feelof an actual transmission in an operating target vehicle.

The transmission top plate 103 also includes the two transmission springloaded detents 107 (left) and 108 (right). The spring detent includes aninitial load detent 113. The initial load detent 113 provides a preloadto the initial force required for movement of the shifting shaft 99.This initial load detent 113 is applied to the right 108 and/or left 107spring loaded detents. The purpose of the detents is to simulate theforce and feel of a manual transmission.

Optionally, a pneumatic range switch 117 and a pneumatic splitter switch(not visible) are provided on the shifter handle 98, mounted on the topportion of the shifter shaft 99. The operation/position of the pneumaticrange switch 117 and the pneumatic splitter switch 118 are detected bythe ranged switch detector 119 are communicated to the computer 100.These simulate the range and splitter switch for a manual transmission.The position of these switches is used by the training system 10 duringvarious driving scenarios.

A “Y” position sensor 121 and a “X” position sensor 122 are located onthe bottom plate 104. The “Y” position and “X” position of the shaft 99are communicated to the computer 100 by the “Y” position sensor 121 and“X” position sensor 122 respectively.

Located in or on the shifter handle 98 is a hand position sensor 118.The hand position sensor 118 detects if the trainee's 5 hand is inproximity to the top of the shifter shaft, providing the computer 100with information regarding hand placement. In a preferred embodiment,the hand position sensor 118 is a proximity detector such as acapacitive or resistive sensor as known in the industry.

Located on the lower portion of the shifter shaft 99 is a shaft forcesensor 123 (FIG. 8). The shaft force sensor 123 provides a signal to thecomputer 100 indicating an amount of force exerted on the shaft by thetrainee 5. When an excessive force is determined (e.g. an over loadcondition), the computer 100 signals an alarm (e.g. audio signal overthe audio system 18).

Referring to FIG. 9, a schematic view of an exemplary training system isshown. As discussed prior, it is anticipated that one or more of thefollowing described features is or is not present in all embodiments.For example, in some embodiments, there is no trainee sensor 13 thatdetermines where the trainee 5 is looking, etc.

Central to the training system 10 is a computer 100. Many differenttypes of computers 100 are anticipated such as personal computers,dedicated computers and server computers. It is anticipated thatcomputers 100 of one training system 10 are connected by local or widearea networks to other training systems 10 and/or to central datacollection and control systems (not shown). In some embodiments, thecomputer has a motherboard with multiple PCI-Ex16 slots that providemultiple simulator display channels with 2D and/or 3D capability. Avideo processor card is optionally installed in each of these slots. Thevideo cards run the simulation in multi channel mode with low transientdelay times. It is anticipated, though not required, that a single imagegenerator (single motherboard computer) can drive multiple displays.Although any number of display channels is anticipated, the trainingsystem typically is configured with from 3 to 8 real time interactivescreens.

The computer 100 includes, in some embodiments, a display device orterminal device 140. This device 140 has a display screen, a keyboardand/or a touch screen and is primarily used by an administrator tooperate the computer 100, for example, performing backups and othersystem administration function. In some embodiments, these functions areperformed using one or more of the other components/displays 12/14/16.

The computer 100 also includes persistent storage 110/120 such as harddrives, flash memory, etc. for storage of, for example, courseware 110and user information 120. In a preferred embodiment, the persistentstorage 110/120 is one or more hard drives or solid-state drives. Insome embodiments, the storage 110/120 is a raid system to provide morereliable data storage.

Interfaced to the computer 100 are several components of the trainingsystem 10. The windshield display 12, dashboard (e.g. dashboard graphicsdisplay and touch screen) 14 and information display 16 are allinterfaced to the computer 100 as known in the industry. The mirrordisplays 42/43/44 (when present) are also interfaced to the computer 100as known in the industry. All specialized hardware devices such as theshifter touch detector 118 (also the X-position, Y-position, switchstatus not shown for brevity reasons), clutch 36 (position and force),gas pedal 32 (position and force), brake pedal 34 (position and force)and steering wheel 30 (rotation and touch) are also interfaced to thecomputer 100 as known in the industry. It is preferred that some or allof such interfaces are bi-directional to provide control of the device(e.g. vary the counter-force of the brake pedal 34 or gates of thetransmission 80) and to receive feedback from the device (e.g.sufficient pressure was applied to the brake pedal 34, hands are on thesteering wheel 30 or the trainee 5 successfully shifted from first gearinto second gear).

In embodiments that have trainee sensors 13 such as cameras, etc, thetrainee sensors 13 are interfaced to the computer 100 as known in theindustry.

In embodiments that have hand proximity sensors 118 (on shifter handle98, the hand proximity sensors 123 are interfaced to the computer 100 asknown in the industry.

In embodiments that have shifter force sensors 123 (on shifter shaft 99,the shifter force sensors 123 are interfaced to the computer 100 asknown in the industry.

In some embodiments, one or more biometric sensors 15 are interfaced tothe computer 100. The biometric sensors 15 sense, for example,fingerprints, retina, face characteristics, etc, of a user of thetraining system 10 to make sure the training and results correspond tothe correct trainee 5, thereby preventing one trainee 5 fromintentionally or unintentionally scoring/learning for another trainee 5.

In embodiments having a sound system 18, the sound system 18 isinterfaced to the computer 100 as known in the industry such as audiooutputs connected to amplifiers and speakers, TOSLINK, USB, etc.

In embodiments having a transmission transducer 106, the transmissiontransducer 106 is interfaced to the computer 100 as known in theindustry such as through audio outputs connected to amplifiers andspeakers, TOSLINK, USB, etc or over a local area network (see FIG. 12).

Referring to FIG. 10, a flow chart of a training model of the prior artis shown. This represents either one segment of a training method or theentire training method of the prior art. In it, a first scenario/segmentis selected 300 then run 302 and data is captured 304 during and/orafter the scenario/segment is run. An example of a simplescenario/segment is a simulation of driving down a road way, approachingan unmarked intersection and a vehicle pulls out from the intersectioninto the path of the trainee 5. If the captured data indicates a majorissue occurred 306 such as the trainee 5 didn't apply the brakes,records are made and the appropriate training personnel are notified320.

The data is analyzed 308 to determine the performance of the trainee 5in the given scenario/segment meets passing requirements. If not, thescenario/segment is repeated 302/304/306/308. If the trainee 5 meetspassing requirements 308, it is determined if there are morescenarios/segments 312 for the trainee 5 (e.g. scenarios/segments areoften grouped in chapters and the trainee 5 is finished when he/shecomplete a chapter, etc). If there are more scenarios/segments 312, thenext scenario/segment is retrieved 314 and the above steps302/304/306/308/312 are repeated until there are more scenarios/segmentsplanned for the trainee 5 and the captured data is stored 316 forprogress analysis, grading, etc.

The methods of the prior art do not adapt to the trainee's 5demonstrated abilities, running scenarios/segments sequentially,independent of any progress that the trainee 5 has made. For example, ina set of scenarios/segments are crafted to teach defensive driving,offending vehicles are displayed moving into the path of the trainee 5.If the trainee 5 demonstrates excellent responses to each of the firstfew scenarios/segments, the latter scenarios/segments are stillpresented, often boring the trainee 5. Similarly, if the trainee 5 showsa weakness in a certain operation such as double-clutching, the priorart would only repeat the scenarios/segments until the trainee 5 is ableto pass that segment. In the later situation, it is desirable to accessother scenarios/segments that may have already been completed for extratraining on the operation of which the trainee 5 is having difficulty.The prior art does not address such operation to adapt to thedemonstrated abilities of the trainee 5.

Referring to FIG. 11, a flow chart of the adaptive training system isshown. Typically, a chapter or portion of a training course (courseware110) is presented in one session to the trainee 5. The methods disclosedmonitor the demonstrated abilities (or lack thereof) of the trainee 5and adapt the training course to such. In this, a first scenario/segmentfrom the chapter is selected 400 then run 402. Data is captured 404during and/or after the scenario/segment is run. An example of a simplescenario/segment is a simulation of driving down a road way, approachingan unmarked intersection and a vehicle pulls out from the intersectioninto the path of the trainee 5. If the captured data indicates a majorissue occurred 406 such as the trainee 5 didn't apply the brakes,records are made and the appropriate training personnel are notified430. In some situations in which a major issue occurred 406, the driveris notified on one or more of the displays 12/14/16, preferably theinformation display 16. As part of the adaptive process, elements thatled up to the major issue are isolated/determined 432 and, as necessary,prior scenarios/segments (e.g., the training system 10 remains insimulation mode and presents the scenario/segment) or training chapters(e.g., the training system 10 enters a training mode to present thetraining while the trainee 5 remains in the simulator) are presented 434to the trainee 5 to fortify the trainee's abilities on these elements.For example, if the trainee 5 didn't apply the brakes correctly becausethe trainee 5 was having trouble downshifting, then thescenarios/segments or chapters related to double clutching are scheduledto be repeated for that trainee 5 or are selected and run.

If no major issue is identified 406, the data is analyzed 408 todetermine the performance of the trainee 5 in the given scenario/segmentmeets passing requirements and information is displayed 410 to thetrainee 5 on one or more of the display devices 12/14/16. If theperformance indicates that the trainee 5 didn't perform the tasksufficiently 412, a new scenario/segment is selected 414. The newscenario/segment is selected 414 based upon elements of the priorscenario/segment that were not adequately performed. Since the method isadaptive, the method uses any existing or modified scenario/segment tofortify the element that was not adequately performed. For example, ifwhile the training system 10 is in the simulation mode, the trainee 5avoided the collision but the trainee 5 didn't step on the clutch whileapplying the brakes, therefore stalling the engine, one or more trainingscenarios/segments or chapters related to proper use of the clutch whilebraking are selected 414 to be presented to the trainee 5 either duringthe current session (e.g. the training system 10 enters a training modeand the training scenario/segment is presented while the trainee 5remains in the training system 10) or during a future session.

If the trainee's 5 performance meets passing requirements 412, the data(e.g. results) are stored 416 for later reporting/analysis/grading andit is determined if there are more scenarios/segments 418 for thetrainee 5 (e.g. scenarios/segments are often grouped in chapters and thetrainee 5 is finished when he/she complete a chapter, etc). If there aremore scenarios/segments 418, the next scenario/segment is retrieved 420and the above steps 402-418 are repeated until there are morescenarios/segments planned for the trainee 5.

The methods of the prior art do not adapt to the trainee's 5demonstrated abilities, running scenarios/segments sequentially,independent of any progress that the trainee 5 has made. For example, ina set of scenarios/segments are crafted to teach defensive driving, eachpresenting offending vehicles moving into the path of the trainee 5, ifthe trainee 5 demonstrates excellent responses to each of the first fewscenarios/segments, the latter scenarios/segments are still presented,often boring the trainee 5. Similarly, if the trainee 5 shows a weaknessin a certain operation such as double-clutching, the prior art wouldonly repeat the scenarios/segments until the trainee 5 is able to passthat segment. In the later situation, it is desirable to access otherscenarios/segments that may have already been completed for extratraining on the operation of which the trainee 5 is having difficulty.The prior art does not address such operation to adapt to thedemonstrated abilities of the trainee 5. The present invention addressesthese and other shortcomings of the prior art through adapting to thetrainee's 5 demonstrated abilities to determine which segments/scenariosneed to be presented or re-presented next or in the future. In someembodiments, the segments/scenarios are marked for review to bere-presented during another session. In some embodiments, the data isstored and the next time the trainee 5 accesses the training system 10,the training system 10 analyzes the data to determine the moremeaningful segments/scenarios that need be run to concentrate on areasthat are the weakest, etc.

Referring to FIG. 12, a schematic view of a typical computer 100 isshown. The example computer 100 represents a typical computer systemused as the heart of the training system 10. The example computer 100 isshown in its simplest form, having a single processor. Many differentcomputer architectures are known that accomplish similar results in asimilar fashion and the present invention is not limited in any way toany particular computer system. The present invention works wellutilizing a single processor system, a multiple processor system wheremultiple processors share resources such as memory and storage, amultiple server system where several independent servers operate inparallel (perhaps having shared access to the data or any combination).In this, a processor 610 is provided to execute stored programs that aregenerally stored for execution within a memory 620. The processor 610can be any processor or a group of processors, for example an IntelPentium-4® CPU or the like. The memory 620 is connected to the processorin a way known in the industry such as by a memory bus 615 and is anymemory 620 suitable for use with the selected processor 610, such asSRAM, DRAM, SDRAM, RDRAM, DDR, DDR-2, flash, FEROM, etc.

Also connected to the processor 610 is a system bus 630 for connectingto peripheral subsystems such as a network interface (not shown), apersistent storage 640 (e.g. a hard disk, semiconductor storage such asflash, a raid system, etc), a disk drive 650 (e.g. DVD), one or moregraphics adapters 660, a keyboard/mouse 670 and/or one or more touchscreen interfaces 675. The graphics adapter(s) 660 receives commands anddisplay information from the system bus 630 and generates a displayimage that is displayed on one or more of the graphic display devices12/14/16/42/43/44.

In general, the hard disk 640 may be used to store programs, executablecode and data (e.g. courseware 110 and user data 120) persistently. Fordata security and reliability, in some embodiments, the hard disk 640 ismultiple disks or a raid system, etc. The removable disk drive 650 isoften used to load CD/DVD/Blue ray disks having programs, executablecode and data onto the hard disk 640. These peripherals are examples ofinput/output devices, persistent storage and removable media storage.Other examples of persistent storage include core memory, FRAM, flashmemory, etc. Other examples of removable disk drives 650 include CDRW,DVD, DVD writeable, Blue ray, compact flash, other removable flashmedia, floppy disk, etc. In some embodiments, other devices areconnected to the system through the system bus 630 or with otherinput-output connections. Examples of these devices include printers;graphics tablets; joysticks; audio components; and communicationsadapters such as modems and Ethernet adapters.

Although there are many ways anticipated for connecting training systemcomponents 13/30/32/34/36/106/118/123 to the processor, one preferredinterface is a bi-directional local area network such as Car AreaNetwork (CAN) 685 connected to the bus 630 by a Car Area Network (CAN)interface 680 as known in the industry. Any connection scheme to thesystem components 13/30/32/34/36/106/118/123 is anticipated includingdirect wiring, any local area network (e.g. Ethernet, CAN or VAN) andwireless (e.g. Bluetooth).

Equivalent elements can be substituted for the ones set forth above suchthat they perform in substantially the same manner in substantially thesame way for achieving substantially the same result.

It is believed that the system and method as described and many of itsattendant advantages will be understood by the foregoing description. Itis also believed that it will be apparent that various changes may bemade in the form, construction and arrangement of the components thereofwithout departing from the scope and spirit of the invention or withoutsacrificing all of its material advantages. The form herein beforedescribed being merely exemplary and explanatory embodiment thereof. Itis the intention of the following claims to encompass and include suchchanges.

What is claimed is:
 1. An adaptive training system comprising: acomputer, the computer having a storage device; a cabinet; a pluralityof interactive training segments stored on the storage device andaccessible by the computer; a plurality of simulation segments stored onthe storage device and accessible by the computer; a graphics displaymechanically interfaced to the cabinet and electrically interfaced tothe computer, the graphics display simulates a windshield of a targetvehicle, the computer generates still and full-motion images that aredisplayed on the graphics display; a plurality of input devices, each ofthe input devices electrically interfaced to the computer such that as atrainee operates each of the input devices, an electrical signal isreceived by the computer indicating a position of the input devices, theinput devices corresponding to control devices of the target vehicle, atleast one of the plurality of input devices is a steering wheel and atleast one of the plurality of input devices is a brake pedal; thecomputer operates in either of two modes of operation, a first mode ofthe two modes of operation being a simulation mode in which the computerdisplays video frames from one of the simulation segments on thegraphics display and receives electrical signals from the plurality ofinput devices, and a second mode of the two modes of operation being atraining mode in which the computer displays video and/or text from oneof the interactive training segments on the graphics display andreceives electrical signals from at least one of the plurality of inputdevices indicating responses from the trainee; the computer operates inthe simulation mode in which the computer displays the video frames onethe of the simulation segments on the graphics display and receives theelectrical signals from the plurality of input device and responsive tothe electrical signals, the computer controls which of the video framesare displayed on the graphics display; and the computer analyzes theelectrical signals in view of the one of the simulation segments todetermine if a driving issue has occurred while the computer is operatedin the simulation mode by comparing the electrical signals receivedduring the simulation mode to expectation of the one of the simulationsegments and if the driving issue has occurred, the computer immediatelychanges to operate in the training mode and presents one or more of theinteractive training segments while the trainee remains within thecabinet of the adaptive training system including the display of videoand/or text from one of the interactive training segments on thegraphics display.
 2. The adaptive training system of claim 1, whereinthe plurality of input devices further includes at least one deviceselected from a group consisting of a gas pedal, a clutch pedal, asimulated transmission position detector, a simulated transmission forcedetector, a simulated transmission touch detector, a simulatedtransmission pressure sensor, a simulated transmission transducer, asteering wheel rotation detector, a steering wheel touch detector, abiometric sensor, and a trainee position detector.
 3. The adaptivetraining system of claim 1, wherein the adaptive training systempresents windshield views on the display while in the simulation modeand the adaptive training system presents the graphic or video from theinteractive training segments on the display while in the training mode.4. A method of training a trainee on a training system during a sessionin which the trainee remains within a cabinet of the training system,the method comprising: the training system presenting a simulationincluding displaying motion video on a graphics display of the trainingsystem; the training system receiving electrical signals from one ormore input devices of the training system, the electrical signalsproportional to a position of each of the one or more input devices; thetraining system analyzing the electrical signals with respect toexpected electrical signals from the simulation and determining if thetrainee has committed a driving issue; and if the trainee has committedthe driving issue, the training system presenting an interactivetraining that is related to the driving issue while the trainee remainswithin the training system and the training system receiving theelectrical signals from at least one of the input devices responsive tothe interactive training.
 5. The method of claim 4, wherein the step ofpresenting interactive training includes displaying training informationon the graphics display of the training system that simulates awindshield of a target vehicle and receiving the electrical signals fromthe at least one of the input devices indicating responses by thetrainee to the interactive training.
 6. The method of claim 5, whereinthe step of presenting interactive training includes displaying videosegments or graphic information on a graphics display of the trainingsystem while the trainee remains within the training system.
 7. Themethod of claim 5, wherein the one or more input devices is selectedfrom a group consisting of a keyboard, a gas pedal, a brake pedal, aclutch pedal, a simulated transmission position detector, a simulatedtransmission force detector, a simulated transmission touch detector, asimulated transmission pressure sensor, a simulated transmissiontransducer, a steering wheel rotation detector, a steering wheel touchdetector, a biometric sensor, and a trainee position detector.
 8. Themethod of claim 5, wherein the step of presenting interactive trainingincludes emitting sound from an audio transducer of the training system.9. The method of claim 5, wherein the step of presenting interactivetraining includes displaying a question on a graphics display of thetraining system, receiving an electrical signal from the at least one ofthe input devices responsive to the question, and evaluating theelectrical signal to determine if the trainee is answering the questioncorrectly, all while the trainee remains within the training system. 10.An adaptive training system comprising: a computer, the computer havingmemory and having storage; a cabinet; a graphics display mechanicallyinterfaced within the cabinet, the graphics display simulates awindshield of a target vehicle, the computer has means for generatingimages on the graphics display; one of more input devices mechanicallyheld to the cabinet, the input devices corresponding to control devicesof the target vehicle, the input devices generate electrical signalsthat are proportional to the operation of the input devices by a traineeand the electrical signals are measured by the computer; software thatis stored in the memory causes the computer to present a simulationdisplaying motion video on the graphics display and to control operationof the simulation based upon operation of the input devices by thetrainee, whereas the electrical signals change based upon operation ofthe input devices by the trainee, thereby the computer simulates anoperation of the target vehicle; the software analyzes the electricalsignals with respect to the simulation and determines a level ofcompetency for one or more aspects of the simulation based uponoperation of the input devices by the trainee; and if the level ofcompetency of one of the aspects of the simulation is less than anexpected value, the software presents interactive training on thegraphics display and receives the electrical signals from at least oneof the input devices indicating responses to the interactive training bythe trainee while the trainee remains within the cabinet.
 11. Theadaptive training system of claim 10, wherein the one or more inputdevices is selected from a group consisting of a keyboard, a gas pedal,a brake pedal, a clutch pedal, a simulated transmission positiondetector, a simulated transmission force detector, a simulatedtransmission touch detector, a simulated transmission pressure sensor, asimulated transmission transducer, a steering wheel rotation detector, asteering wheel touch detector, a biometric sensor, and a traineeposition detector.
 12. The adaptive training system of claim 11, whereinthe one or more input devices further comprising a shifting inputdevice, the shifting input device having a hand touch sensor, the handtouch sensor signaling the computer to indicate a hand of the trainee incontact with a handle of the shifting input device.
 13. The adaptivetraining system of claim 10, wherein the software also presents theinteractive training on an audio output device that is electricallycontrolled by the computer.
 14. The adaptive training system of claim11, wherein the trainee responds to the interactive training by typingon the keyboard while remaining within the adaptive training system. 15.The adaptive training system of claim 10, wherein the trainee respondsto the interactive training by emitting a sound, the sound is receivedby a microphone within the cabinet and the microphone converts the soundinto an electrical signal that is received by the computer and analyzedby the software.